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Abstract 

Distributed computing systems have the potential to increase the usefulness of ex- 
isting facilities for computation without adding anything physical, but that is realized 
only when necessary administrative features are in place. In a distributed environment, 
the best match is sought between a computing job to be run and a computer to run 
the job (global scheduling), which is a function that has not been required by conven- 
tional systems. Viewing the computers as “suppliers” and the users as “consumers” of 
computing services, markets for computing services/resources have been examined as 
one of the most promising mechanisms for global scheduling. We first establish why 
economics can contribute to scheduling. We further define the criterion for a scheme to 
qualify as an application of economics. Many studies to date have claimed to have ap- 
plied economics to scheduling. If their scheduling mechanisms do not utilize economics, 
contrary to their claims, their favorable results do not contribute to the assertion that 
markets provide the best framework for global scheduling. We examine the well-known 
scheduling schemes, which concern pricing and markets, using our criterion of what ap- 
plication of economics is. Our conclusion is that none of the schemes examined makes . 
full use of economics. 
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1 Scheduling in Distributed Computing Systems 

A distributed computing system brings about opportunities for enhancing the efficiency in 
computing, and hence, for increasing the value of existing facilities for computation. At 
the same time, a new system necessitates a new administrative structure for supporting 
its innovative features. One of the indispensable functions in a distributed environment, 
but not found in conventional systems, is to determine which computer in the system 
should run the computing job. For exploiting the full potential of a distributed system, 
which consists of computers with comparable but different capabilities and availability, a 
mechanism is required to gather and compare such information on various computers in the 
system and assign each job to the most appropriate computer. This mechanism, termed 
global scheduling, may take the most primitive form of providing the users with minimal 
hardware information of each computer. Alternatively, it may be sophisticated enough to 
inform the users of the state of computer utilization at the time of job submission, and 
concurrently, give priorities to jobs to which the service would be most valuable . 1 Any 
global scheduling that utilizes the distributed nature of the systems would not be able to 
avoid the complexity that stems from the heterogeneity of the computers and the jobs. 
Viewing the computers as “suppliers” and the users as “consumers” of computing services, 
markets for computing services/resources have been examined as one of the most promising 
mechanisms for global scheduling. 

We first establish why economics, which is a concept broader than markets, can con- 
tribute to scheduling. We do so by examining the factors that they have in common. We 
rely on the foundation of economics that economic agents are all utility maximizers (or 
behave according to their preferences) and, subsequently, we elucidate what constitutes 
the economic motivation and when it comes into being. Where the economic motivation 
leads us, and how pricing affects the outcomes, are briefly discussed. We further define 
the criterion for a scheme to qualify as an application of economics, which is based on the 
idea of economic motivation. Many studies to date have claimed to have applied economics 
to scheduling. If their scheduling mechanisms do not utilize the economic motivation of 
participants, then parts of scheduling functions that have been named bidding, auctions, 
etc. (which we regard as mechanisms that make use of the economic motivation) do not 
merit such naming; they simply obfuscate the issue. 

We examine the well-known scheduling schemes, which concern pricing (the term pri- 
marily used before distributed computing systems became prominent) and markets (the 
term frequently used for distributed systems) with the use of our criterion of what applica- 
tion of economics is. Our conclusion is that none of the schemes examined makes full use of 
economics. As the result, in most cases, the participation of truly economically-motivated 
agents in the scheme would not result in the desirable outcomes as often asserted by the 
studies. In other cases, it is uncleax whether there were any economic decisions for the 
participating agents to make. The aim of this paper is to provide arguments for the above 
assertions, and to ultimately aid in constructing a successful global-scheduling mechanism 
for distributed computing systems. 

x The mechanisms of global scheduling, currently in use, are more elaborate than the most primitive one 
described above, but not by a big margin. 
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2 Scheduling and Economics 

The core problem we face in scheduling computing jobs is exceedingly similar to that in 
the economy. If there were an unlimited amount of computing resources, jobs would be 
executed as soon as they are submitted, eliminating the need for scheduling. As there is 
a limit to the availability of resources, scheduling of computing jobs becomes a problem of 
allocating limited resources. We may envision a situation where the users of computers are 
required to give up the limited resources they are endowed with in exchange for access to 
the computing resources. Further, if the endowment could be used for more than one item 
or occasion, then the allocation of computing resources is precisely the economic problem 
in its most fundamental form. Modern economics is recognized as the science that studies 
human behavior as a relationship between scarce means which have alternative uses, as 
asserted by Robbins [37]. 

The most basic activity in an economy is an exchange of goods and services. Whenever 
there is an exchange of goods or services, a price is established, which is simply the rate 
of exchange of goods or services involved. Thus, when we refer to one of the three, an 
economy, an exchange, and a price, the other two necessarily exist. 2 When the so-called 
pricing of computing resources started to attract increasing attention in the late 1960s, 
it was quickly acknowledged that we can see pricing as a kind of scheduling mechanism 
and that both concern allocation of resources [35]. Pricing stepped into the limelight 
because the most common default scheduling mechanism, first-come, first-served, was often 
combined with additional rules, indicating that it alone was not meeting the needs [35]. The 
advent of networks of computers did not alienate scheduling from economics, and scheduling 
for distributed computer systems has also been recognized as an activity under resource 
management [4, 26]. In the context of operation of fixed-capacity real-time databases [23], 
pricing has been termed as a device for natural admission control and overload management, 
and markets for computing resources have been embraced by many as the key components 
in the operation of distributed systems [3, 6, 7, 13, 20, 25, 28, 33, 41, 44, 45, 48, 49, 50]. 

2.1 The Objective of an Economy 

An additional insight to the economic problem, as defined by Robbins, was provided by 
Hayek [14]. He made it explicit that the problem indeed was how to allocate resources, 
but not in an arbitrary manner. The goal is to allocate resources so that they would be 
used in the best way possible. Inasmuch as the best uses are known only to individuals, 
the economic problem becomes “a problem of the utilization of knowledge which is not 
given to anyone in its totality” [14]. Certainly, this is also the problem posed to the group 
of users who are to share a set of computing facilities. The computing capabilities ought 
to be shared, and for that purpose, information on when each job requires what resources 
and the value of its successful execution is required, but that is usually known only to 
the users themselves. In fact, utilization of users 5 private information has been recognized 
as one of the advantages of pricing over other types of scheduling (“the users themselves 
determine the value of immediate service and produce a service order upon which they 
mutually agree.” [35]). In paraphrasing the economic problem in terms of utilization of 
private information, Hayek gave a refined definition of the ultimate objective of an economy. 

2 Markets axe forums for exchanges of goods and services, where exchanges axe voluntarily initiated. 
Markets do not prevail in all types of economies, and economies are not synonymous with markets. For 
example, the planned economies of communist regimes were not market economies. 
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By pursuing the “best” use of each resource, our attempt to allocate resources with the use 
of private information becomes one of maximizing values that are associated with resource 
use. 

2.1.1 Pricing and Division of Gains from Trade 

One of the potential advantages of pricing computing resources, i.e., utilization of private 
information, is linked to another aspect of pricing as the above discussion suggests: the 
possibility of maximizing the value of resource use [9, 35]. Hayek did not spell out whose best 
use should be realized, however, when one’s best use becomes feasible only at the expense 
of another’s, although that is a commonly encountered difficulty in resource allocation. 
Theoretically speaking, when an economy consists of utility-maximizing agents, there often 
exist multiple Pareto-optimal solutions, if one exists. 3 The principle of value maximization 
leaves unanswered the question of division of gains from trade, 4 or whose value should be 
maximized when that entails lowering of others’ values. 

“The value of resource use” seems to have meant the sum of the users’ and/or the ad- 
ministration’s values in the allocation of computing resources; “[the] ordering [determined 
by prices] will maximize the value to the organization of the computing actually performed” 
[35], or “when preferences are uniformly expressed in terms of price, the strategy of allo- 
cating resources to those willing to pay the highest price insures the maximization of total 
utility realized by the use of these resources” [9]. Profit maximization or cost recovery (for 
which profits should be sought) as an overall goal for a computing system are cases of value 
maximization, where the administration’s or the computer vendor’s value is given priority. 5 

What is true, regardless of the answer to the question of division of gains from trade, is 
that pricing policy is one of the most critical determinants in the division. When resources 
are allocated to the users who need them most, the users’ value would be maximized if they 
are provided free, and the service provider’s value would be maximized if each user pays 
the amount equal to his/her willingness to pay for each unit of service. Various pricing 
policies are adopted for meeting different goals. 

2.1.2 Scarcity of Resources, Alternative Uses, and Value 

We now turn to what is often overlooked when discussing a system that consists of value- 
maximizing agents: the importance of scarcity of resources, including budget, and that of 
the existence of alternative uses of resources in the formation of value itself. Robbins’s 
definition of what economics is as a discipline, given above, involves “scarce means, which 
have alternative uses[J” indicating that there are always competing needs for resources and 
budget in economies. Such a variety of needs, which cannot all be fulfilled and each of 
which leads to an outcome that is different in importance, is what brings the economic 
problem into its existence. 6 If resources are obtainable whenever desired, there would be 

3 See, for example, Sections 17.D-F of Microeconomic Theory [29]. 

4 In most circumstances, a trade or an exchange takes place only when all parties involved agree to it, 
and that is when all of them consider the trade beneficial to themselves. Thus, barring fraud and other 
similar schemes, a voluntary exchange always brings gains to all involved. However, how much each party 
would gain depends on the terms of trade, among others. 

5 If a computer is “on lease” to an institution and the computer vendor sells computing service, but 
not the computer itself, then the vendor would adopt a pricing policy which is usually aimed at profit 
maximization or cost recovery. 

6 Although Robbins’s quote is considered the definition of modern economics, one of the necessary ingre- 
dients of the economic problem has been mentioned only earlier in his essay: difference in outcomes with 
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no question of allocating the resources for their best use or to maximize value from use. In 
Nielsen’s words, “[a]n object takes on value only when it is scarce.” 

We distinguish two types of scarcity. It may take the straightforward form of a finite 
limi t to the amount available, an amount smaller than is required to fulfill all needs, in 
which case the multiplicity of possible uses of the resource leads to the economic problem. 
If a limited amount of resource is available during a particular time period (which cannot 
be used any other time) and that resource has only one use, there is but one possibility: 
allocation of the entire amount for that single use. In short, there is no economic problem 
under scarcity of resources if there are no alternative uses. Scarcity may take another form 
of resources having dual effects, each of which is associated with a positive or a negative 
value and magnitude depends on the amount allocated. 7 The second type of scarcity also 
serves the function provided by alternative uses in the first kind. Both the existence of 
alternative uses (in the first kind of scarcity) and the possible negative effects of resource 
use (in the second type of scarcity) make it necessary for resource users to evaluate and 
compare the values of various allocations. 

Pricing, therefore, plays an insignificant role in the exercise of value maximization, 
absent scarcity. For a multiple service-class network, Cocchi et al. [8] showed that prices 
did not have much effect in maximizing the value of computer usage if the work load was 
light. For fixed-capacity, real-time databases, Konana et al. [23] showed that there were 
bigger net system benefit and consumer surplus when job arrival rates were higher. 8 The 
economic problem comes into being only when resources have multiple positively valued 
uses and the resources are scarce, or when resources’ positively valued uses cannot be 
dissociated from negatively valued ones. 

2.2 Price Related Issues in Scheduling 

We briefly discuss two issues related to pricing: accounting and prioritization. Accounting 
in economic terms assumes the existence of price on every item to be accounted. In fact, the 
desire to record the usage of various computing resources in a consistent manner appears 
to be one of the drives behind pricing. Prioritization of jobs is often adopted together with 
a price for every priority level, and we argue below that prioritization is a special case of 
what is usually called pricing [9]. 

respect to importance. Robbins wrote (the emphasis is from the original text): “But when time and the 
means for achieving ends are limited and capable of alternative application, and the ends are capable of 
being distinguished in order of importance, then behavior necessarily assumes the form of choice. Every act 
which involved time and scarce means for the achievement of one end involves the relinquishment of their 
use for the achievement of another. It has an economic aspect.” We consider time one of the scarce means, 

because we usually have time limits to whatever we do. 

7 In terms of utility-maximization problems, the first form of scarcity corresponds to a constraint on 
the amount of resources, which together with the objective function and other constraints forms a concave 
Lagrangian (if a static problem) or Hamiltonian (if a dynamic problem). The second form corresponds to 
a case where the objective function by itself is concave, and if there is any non-resource constraint, the 
pertinent Lagrangian or Hamiltonian is also concave. 

®A user was assumed to have an instantaneous value for a data request if granted, which depended on 
the realized data-flow rate. The net system benefit was defined to be the aggregate value to the users minus 
the delay cost to all users. Consumer surplus is the difference between the price consumers are willing to 
pay and the price actually paid, summed over all consumers. 
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2.2.1 Pricing and Accounting 

A trade would be complete upon exchange of goods and services, if parties involved are 
willing to give to the others exactly what is desired. However, if there is no such double 
coincidence of wants, a unit for assessing the trade or a medium of exchange (whose unit 
serves as that for trade assessment) would be necessary. If a physical exchange of the 
medium does not accompany the exchange of goods and services, a record of the exchange 
of goods and services must be kept: accounting. 9 It is often the case that several exchanges 
need to be summarized as if it were one, which requires a common unit for exchanges. In 
making economic decisions, a common unit is a must if there exists more than one input 
and the inputs could be combined in various ways to produce different outputs [34]. 

In distributed computing systems, the need for a common unit for exchanges is a variant 
of the above situation. The users do not have anything to offer to the resource suppliers that 
is of direct value to them (e.g., computing resources that the suppliers could use themselves 
or sell). What the users are supposed to give to the suppliers in exchange for the resources is 
their resource-use allowance, and this condition necessitates a unit for converting allowance 
into charges for computing resources, or a common unit for both of them. The spirit of 
distributed systems is to confer users the ability to access any resource available in the 
system. This, in turn, requires conversion factors for resource-use allowance and resource- 
charge of all computers in the system, or a common unit for all of them. If there is only one 
type of resource to be charged for and the quality of that resource is uniform in the system, 
it suffices to define computer-use allowance in terms of unit of that resource (e.g., CPU 
time). When more than one type is to be accounted for (e.g., CPU time and memory) and 
the quality of the resources differ from computer ‘to computer (and/or different combination 
in quantities would be in use), accounting for overall use would require a unit which could 
measure uses of all resources concerned. Price is often considered a natural candidate for 
such a common unit. 

Pricing, by itself, does not guarantee a common unit for resources, which may be used for 
trade assessment. A price of a certain good, in its basic form, is the amount of other goods, 
a unit of the good in question would fetch. If all resources are exchangeable with, at least, 
one common good, then that good may serve as the common unit. It is not imperative for 
the unit good to have any intrinsic value; a bill as we know today is a medium of exchange, 
and has little value of its own, that of a small piece of paper. Unfortunately, a common 
unit is not the last necessary element for establishing a good accounting system. A good 
accounting system is reproducible, equitable, auditable, and understandable [9]. Moreover, 
users should be charged for the resources that were made unavailable because of their job 

Note that the contemporary definition of accounting in the field of accounting itself usually takes a 
more applied view, with the existence of shareholders in mind. For example, Horngren et ai [17] defined 
accounting to be “the process of identifying, recording, summarizing, and reporting economic information 
to decision makers.” According to Stickney et ai [43], “[accounting is a system for measuring the results of 
business activities and communicating those measurements to interested users.” Edmonds et ai [11] defined 
an accounting event to be “an economic occurrence that causes changes in an enterprise’s assets, liabilities, 
and/or equity,” and an account to be “a record used for the classification and summary of transaction data.” 
They wrote: “How much emphasis should society place on the production of food versus the development 
of a cure for cancer? Should we devote more time and energy to making computers or cars? Should a city 
build a new football stadium or a museum? Accounting provides information that is useful in answering 
resource allocation questions such as these.” Sidebotham [40] drew on the history of accounting, and arrived 
at a broader definition: At each stage of development men have employed accounting, according to their 

needs, to enumerate and control assets, as a reporting device for stewards and tax-gatherers, as evidence of 
trade, for the control of production, or the management of business.” 
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execution, probably including the resources that were not used by the job but whose use 
was blocked [9]. Any of these characteristics is not guaranteed by a common unit alone. 

2.2.2 Pricing and Prioritization 

We describe below the relationship between pricing and prioritization of jobs, a method 
often employed in scheduling. Priorities are set by service providers, and, are expressions 
of preferences by the providers. When a certain priority is chosen by a user, that is an 
expression of preferences by the user. Offering and accepting a certain price are analogous to 
setting and choosing a particular priority. When a price is offered, it reveals the preferences 
of the offerer, and when it is accepted, it reveals those of the accepting party. The proximity 
of pricing and prioritization in nature is also inferred from the fact that each priority is 
often distinguished from one another not only by policy but also by price. 

The difference between the two lies in the accuracy of expression. A priority mechanism 
allows a choice among a finite number of priorities to the users, whereas a pricing mechanism 
usually allows any number to be picked. Therefore, under a priority mechanism, users would 
choose the priority level that matches their preferences most, which may not be optimal 
had other priorities been available. In terms of price, there can be exactly as many prices 
as there are priorities at one time. Under a pricing mechanism, however, the price that 

exactly suits the preferences could be chosen. 

On priority mechanisms, Cotton [9] observed that they are based on the assumption that 
users are homogeneous and static, leading to suboptimal allocations in view of maximization 
of user utility. There are advantages to a priority mechanism, such as reduced disutility 
from a job’s waiting in a queue, inexpensive cost of administration, and possible control 
of quality by the users [9]. A general pricing mechanism has the potential to differentiate 
resources more dynamically compared to a priority mechanism, but at the cost of increased 
computation for setting prices and uncertainty in price. 

2.3 Application of the Economics to Scheduling 

We have laid out above the problem an economy faces, and clarified the motivation behind 
economic activities. Briefly put, the most basic economic activity is to exchange posses- 
sions. The possibility of exchange exists when the exchange is positively valued by all 
parties involved. The potential value of an exchange is evaluated with care, only under 
the knowledge that one cannot obtain all that is desired, and such evaluations are borne 
privately. There is no economic problem for a computer user if the budget is unlimited, or 
restricted to be used for a single service and that single use incurs only positive values. 10 

We do not assert that actual economic systems perfectly utilize private information 
to allocate resources for their best possible uses. The economic motivation has given rise 
to numerous tools and institutional arrangements that we observe in the economy. How- 
ever, many of them deliver not only the intended, desirable effects, but also undesirable 
ones. Stockmarket crashes, where a seemingly well-functioning market ceases to be so un- 
predictable and environmental pollution, where firms take advantage of what is at their 
disposal for little cost, attest to this assertion. Hence, despite the similarity between the 
scheduling and the economic problems, it remains to be seen whether any economic device is 

10 In theoretical economics, a representative consumer may have only one good to purchase. However, 
that is usually in a dynamic context, where a good bought at a certain time is distinguished from the same 
good to be bought later, or it is the simplest case to be examined as a basis for a multiple-good framework. 
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preferable over other mechanisms for solving the problem of computing-resource allocation. 
In addition, any successful scheduling method will be characterized by the following fea- 
tures: ease of use and maintenance [39], autonomy of local entities [5, 39], short calculation 
times for determining the schedule (in comparison to time intervals between job arrivals), 
transparency of mechanism to users [35, 39], fairness as agreed by the users concerned [39], 
and effectiveness of its user education program [35]. 

The existence of a motivation to meet an objective is a necessary condition for the 
attainment of the objective, but not a sufficient one. In the following sections, we ana- 
lyze various pricing schemes for computing resources, with this necessary condition as a 
yardstick for determining whether a scheme is an application of economics. When the 
participants in the scheme maximize utility, given constraints, by choosing among desires 
that cannot be simultaneously fulfilled and are different in achievable utility, the economic 
motivation exists, and therefore, the necessary condition is satisfied for calling the scheme 
an application of economics to scheduling. When the attainment of the allocation de- 
sired is impossible without that behavior, the sufficient condition is satisfied for calling 
the scheme an application of economics to scheduling. We divide the necessary condition 
for any scheme to qualify as an application of economics into: participating agents’ util- 
ity maximizing behavior; and, scarcity of resources and the existence of alternative uses 
(in the broad sense, as described earlier in the section), whose resultant utilities are not 
identical. If a computing-service provider is directly involved in the process of determining 
service allocation (i.e., the provider interacts with users in the process), the criterion must 
be satisfied not only by the users but also by the provider. 

As is clear from the above, the knowledge of participating agents’ utility functions 
is indispensable for checking whether the necessary condition is met. This' requirement 
becomes a drawback for schemes which do not employ artificial agents; it is difficult to 
define utility functions for human users, while artificial agents cannot but be provided with 
well-defined rules for their behavior. Our focus is on the most recent development in the 
use of economics in scheduling, and we examine the latest, representative schemes, all of 
which involve or strongly suggest involvement of artificial agents. We also examine pricing 
examples for non-distributed systems from the pre-1990 period, which do not make use of 
artificial agents. 

3 History of Pricing the Computing Resources 

3.1 Functions of Pricing: from late 1960s to mid-1980s 

During the early days of computing, most of the computing processes were sequential and in 
batches. Hence, the possible functions of pricing were narrowed to user-initiated dispersion 
of job submission over time, profit maximization, and cost recovery. 11 

Among the first efforts to price the computing resources, the case reported by Suther- 
land in 1968 [46] has served as the focal point [20, 35, 48]. Sutherland’s scheme aimed at 
attaining only the first function, namely, dispersion of job submission over time. His users 

11 According to Cotton [9], resource allocation and cost recovery represent a dual nature of prices. He 
further asserted that pricing “satisfies dual objectives” (allocation and cost recovery). It is a misleading 
assertion, because allocation itself is not usually considered an objective, but only with some qualification 
such as efficient allocation and equitable allocation. In addition, as Cotton himself cited Nielsen [35], “there 
is no such thing as no allocation. 3 n An allocation is achieved as long as users gain access to computing 
resources in some ways. Finally, pricing does not guarantee cost recovery. 
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needed to interact with their programs; there were hours that were commonly considered 
more convenient, and therefore, more popular than others for running jobs. Based on the 
assumption that jobs have various requirements with respect to completion time, differen- 
tiation of resources was sought through varying the price of computer usage for each time 
segment. The ultimate, but implicit, goal was to enhance the value of computing resources 
not by increasing its physical capacity, but by differentiating resources based partly on user 
information revealed shortly before their possible execution. Two years later, Nielsen [35] 
presented brief descriptions of two pricing schemes that also aimed at congestion allevia- 
tion alone. The logic behind employing a pricing scheme appears to be the same as that of 
Sutherland. Hootman [16] discussed in detail the difficulties in determining the appropriate 
pricing policy, especially those introduced by the time-sharing feature, which became avail- 
able already in the 1960s. His premise was that computer vendors sold computing services 
to the users, but the problems examined and their analyses also apply directly to cases in 
which the computers are owned by the institutions, and it is the administrators who set the 
pricing policies. On a different note, Mendelson [32] conducted a theoretical investigation 
on-'the relationship between user- value maximization and other objectives put forth by the 
administration or the computer vendor (profit maximization and cost recovery). His anal- 
ysis assumed a lower value for the user of a computer, when a submitted job could not be 
executed immediately and waited in the queue longer before its execution. In what follows, 
we discuss these four papers. 

3.1.1 Sutherland’s Scheme 

Sutherland’s remains one of the few schemes of computing-resource pricing that have been 
implemented on a full scale and have attained practicality. In spite of its futures market 
and auctions, we do not know a priori whether the success of the scheme is dependent 
on, or more fundamentally, makes use of, economic behavior of the users. Our analysis 
shows that, most likely, the users did not behave in a utility-maximizing way, ignoring the 
possibility to prey on or collude with other users. Neither did alternative uses exist for 
users’ budget, nor did computer use appear to have dual effects on users’ utility; the second 
item in the necessary condition for qualifying as an economic application was violated. The 
service provider was not directly involved in resource allocation. The futures market and 
auctions did not function like their equivalents in actual economies. The conclusion is that 
the scheme is not an application of economics. 

Economically Motivated Bidding and Community Size 

Sutherland’s [46] scheme was implemented for a PDP-1 computer at Harvard University. A 
budget was allocated to each user in accordance with the importance of the user’s project, 
and it was used for bidding on time segments. Each time segment was a quarter of an hour 
long, whose beginning and end were fixed by the administration. For the purpose of our 
discussion, we define a time slot to be a set of consecutive time segments. The identity 
of bidders was disclosed through their initials which they wrote on the bidding sheet as 
indications of bids. The sheet was accessible to all users of the computer. Bidding for time 
segments on a certain day was allowed until 9 a.m. on the previous day. 12 The budget spent 
on bidding was returned to the user upon completion of the pertinent job or conclusion of 
an unsuccessful bidding. A bid was required to be in an integer, denominated by the unit 

12 We do not know how long in advance the users were allowed to start bidding. 
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for the amount of budget or that for “currency.” 

A higher level of utility is achieved by winning the desired slot than by losing it, other 
things being equal, and the chance of winning is larger when the bid is larger. However, 
economic agents with limited budgets for computing time would not bid the entire budget 
in the hope of winning a particular time slot, if the goal is to run multiple jobs during 
the same budget-period. In contrast, Sutherland’s users should have had every incentive 
to bid the entire budget for every job. This is because the users’ budgets were restored to 
the full after completion of each job and no saving beyond the amount of predetermined 
full-budget was permissible. In other words, utility-maximizing users would have bid the 
whole budget whenever they had a job to run. Examining the example of scheduling given 
in the paper, we find that one of the users bid three units of currency on the first day and 
two units on the second. We conclude that the whole budget was not bid for every run, if at 
all. Indeed, Sutherland did not report that bidding of entire budgets was observed. In sum, 
the utility-maximizing behavior, which must be observed for the scheme to qualify as an 
application of economics, was modified by a non-economic factor. We conjecture that the 
factor was personal judgment on the relative importance of job completion, that of one’s 
own vis-a-vis that of other bidders. The scheme did not satisfy the necessary condition to 
be called an economic application. 

Sutherland justified his budget policy on the grounds that it prevented the computer 
from sitting idle. However, the coffer does not need to be always full, for the purpose of 
avoiding underutilization of computers when there are, in fact, jobs to be run [35]. We may 
adopt the policy of giving, for free, those time segments that would otherwise be unclaimed 
to users without sufficient budget. 13 The advantage of limited, over unlimited, budget 
lies in its encouragement of users to demand according to the intensity of their needs. 
Such utility- maximizing behavior increases the total value of the computing resources to 
users compared to that when bids are made without considering the nature of the job. 
Sutherland’s scheme did not make use of this process. 

Some restrictions were placed on preemptive bids, such as one that bars leaving the 
original bidder with several unconsecutive time segments. 14 Despite the restrictions, the 
adopted set-up is susceptible to user behavior that is undesirable from the system’s point 
of view. For instance, a user with a big budget may wish to run useless jobs, simply for the 
purpose of not giving the time segments to other users with smaller budgets. Such predatory 
behavior was not discouraged, because whenever a job was completed, the relevant budget 
was fully restored; neither pain nor inconvenience was involved in being a predator. Another 
behavior that can be supported by the scheme is that of collusion. The user with the 
smallest budget, for example, may ask a user with a fairly large budget to reserve time 
segments until shortly before the closure of bidding when the user with the small budget 
takes over the slot. 15 

13 This policy may be subject to collusion if the amount of budget remaining cannot be verified. All users 
may claim not to have any unused budget to pay for using the computer when they actually have budget 
to do so. If the leftover budget could be accumulated, users with lower budgets may not participate in 
the collusion fearing the accumulated budgets may be used against them in the future. The tenabiiity of 
such collusion depends on other possible uses of budget and on punishment among the participants in the 
collusive agreement. 

14 Every preemptive bid had to satisfy the following requirements: The beginning or the end of the 
previously claimed slot is bid; and, the resultant remainder of the previously claimed slot is at least an hour 
long (if more than an hour of the slot w’as preempted). Moreover, when a partial preempting of a slot took 
place, the price for the remaining parts of the slot was raised to match the preemption. 

15 Strictly speaking, such collusion is possible only if the user with the big budget also benefits from the 
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Neither kind of behavior was reported. Our conjecture is that the absence of such 
undesirable activities was due to the policy of disclosing bidders’ identities and to the small 
number of users who were granted access to the computer. 16 An implicit norm of neither 
preying nor colluding is more likely to be formed and upheld in a small community, where 
members are well known to each other, than in a large one whose size renders anonymity to 
the members. The small size possibly contributed also to users not bidding the maximum 
possible amounts to fend off all users with smaller budgets, even if there was a genuine 
desire to run a job. That allowed the users with small budgets to access the resources when 
users with bigger budgets judged the necessity of their own job’s execution during the time 
slot in question was small. If the instructions given to the users included terms such as 
futures market, bidding, and currency, that may have induced the users to economize and 
not to bid the whole budget, although such an action had no direct, positive impact on the 
users under the scheme. 

Functionalities of Futures Market and Auction 

Bidding for time segments was closed more than 15 hours before the intended time for 
computer use. In other words, the computing resources were never allocated on the spot 
and only agreements for future uses were permissible. Thus, naming the resultant trading 
mechanism, with the lack of a spot market, a futures market is rather misleading, the 
function of a futures market is to supplement that of a spot market. 

Each time segment was given to the highest bidder by soliciting buying prices, and 
hence, the scheme attempted to make use of one of the prominent features of auctions: 
possible revelation of users’ preferences (in this case, those for time segments), which are 
private information without direct inquiries. However, as described above, the users had all 
the economic incentive to bid their entire budgets. If they did bid the maximum amounts 
possible, the priority of a job for any time slot would have been completely determined by 
the relative budget-sizes of users who bid for that time slot. No room remained for utility- 
maximizing users to reveal their preference with respect to each run, i.e., the importance 
of its completion during a particular time slot. Owing to the budget policy adopted, the 
implemented auction was not guaranteed to be one in a proper sense. We conclude that 
the scheme does not exploit the functionalities of a futures market or an auction. 

Significance of Non-Economic Behavior 

It is possible to argue that the users did maximize utility through acting in an altruistic 
manner. However, we are less certain about an economic agent’s utility from being altruis- 
tic, compared to more direct benefits to the agents themselves. There was no explicit reward 
for being considerate toward other users. Moreover, the possibility of a lower value to be 
placed on selflessness is pertinent, especially for large systems where users are unknown 

agreement. Since there was nothing the user with a small budget could give to the other in return under 
the scheme, there needed to be some kind of a out-of-the-scheme settlement for the collusion described. 

16 The exact number of users was not given. We may guess its order of magnitude from the fact that 
seventeen distinct users are identified on the sheet for two days’ schedule, and another fact that bidding 
was done by users’ handwriting on the sheet in “a computer room[.]” Our conclusion is that the size of the 
group was small. 

17 A futures contract is an agreement to buy or sell a fixed quantity of a particular commodity, currency, or 
security for delivery at a fixed date in the future at a fixed price. Futures markets, where futures contracts 
are made, decreases price uncertainty and enhances trading by risk averse traders who would be less active 
were there only spot markets. 


11 



to each other. Our conclusion is that the implementation was a success (in Sutherlands’ 
words: “This auction scheme for allocating computer time works better than any other I 
have used”), having been able to incorporate user information, precisely because the eco- 
nomic motivation was not in full use and tempered by selfless attitude. The scheme may 
work for certain small groups, but unlikely for large ones. 

3.1.2 Nielsen’s Examples 

Nielsen [35] provided two implementations of pricing, one each for a large and a small 
community. The details of neither of them is known, preventing us from judging whether 
they were economic applications or not. 

Scheme for a Large Community 

In his paper published in 1970, Nielsen gave a brief report on two cases of pricing com- 
puting resources. One involved computing services provided to a body of students, faculty 
members, and researchers at Stanford University, about 5,000 of them, for the purpose of 
general education and research. It appears that the operation cost had to be covered by 
the charges for computing service, for which funds in dollars were given to the users by the 
university. It is not clear whether charges were supposed to cover the installation cost as 
well. There was a basic rate structure, which was adjusted approximately quarterly and 
consisted of prices on 18 types of services (terminal rental, leased communication lines, 
card punching, batch processing service, etc.). The paper implies that the pricing system 
was functional, but there is no indication as to whether the goal of cost recovery was met. 
We also do not know how the prices were determined and how superior the pricing, as 
implemented, was compared to other resource allocation methods. 

Scheme for a Small Community 

Nielsen’s second example concerns a smaller community of about 200 physicists at the 
Stanford Linear Accelerator Center where most of the jobs were batch-processing. A pricing 
scheme was planned at the time of reporting, apparently not for cost recovery, but for user- 
initiated dispersion of job submission over time. The planned base-rate schedule consisted 
of six rates, including CPU cycles, memory space-time, Input/Output operations, and disk 
mounting. In addition, priority levels, four for batch-processing service and two for printing, 
were proposed; higher prices for the same computing, if the job was to be executed ahead of 
the place in queue given by the standard scheduling order. Other components of Nielsen’s 
pricing system, such as price determination, appear to have been under discussion at the 
time of publishing. 

3.1.3 Hootman’s Analysis of Pricing and Time-Sharing 

Hootman [16] summarized the pricing situation in the late 1960s as “rangfing] all over the 
lot” because of the new computing feature that had become available: time-sharing. Based 
on his observations, we arrive at some of the inevitable and undesirable characteristics of 
pricing policy for computing resources under time-sharing. 

Complications from Time-Sharing 

Hootman identified an objective commonly adopted, in addition to cost recovery (i.e., 
pricing “[b]ased upon cost”) and profit maximization (i.e., pricing “[b]ased upon [‘]what 
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the market will bear[’]”): undercutting the competitors’ pricing (i.e., pricing “[b]ased upon 
competitive alternatives”). Competitive pricing is possible only if users have access to 
multiple service providers, which is not the case with other three studies of the same period 
examined in this paper. His impression was that ad hoc pricing schemes, not based on any 
of the principles above, were becoming the most prevalent. 

Besides the problem of generating sufficient revenue, which is at the root of the three 
objectives mentioned above, Hootman listed three important pricing issues in a time-shared 
environment. One is the demarcation between resources the users have control over and 
those they do not. The demarcation problem can be further divided into: how to measure 
the overhead (i.e., what the users do not have control over), and how much of the overhead 
the users should be considered responsible for, in terms of charge. The assumption is that 
users would not object against paying for resources whose usage they can hardly deny or 
conceal, but would object if they are asked to pay for resources whose users cannot be 
easily defined and identified. The intricacy of the problem stems from the possibility of 
multiprogramming and multiprocessing, and also from the presence of a communications 
preprocessor. Another important issue in pricing a time-shared environment concerns de- 
murrage, i.e., how to charge for resources which become unavailable simply due to the use 
of other resources. Finally, he listed understandability of the pricing system by the users 
as the third of the three important issues. Among these problems, his analysis focused on: 
measurement of usage, in particular, overhead; and, decision with respect to what portion 
of overhead should be charged to the users. 

Consequences of Overhead and Lack of Information — — — — 

Having discussed the pricing problem in general, Hootman analyzed the specificities of the 
problem for major hardware components (e.g., memory, auxiliary memory) and for software 
(e.g. , proprietary programs). There appears to be no easy solution to these problems, not 
to mention one that could be agreed to by the majority of the computing community. The 
difficulty in these two aspects of pricing is compounded by the fact that little is known 
about the use of different components of computers and user behavior. We also have the 
restriction that the amount of resources required for setting the price should not be too 
large; otherwise, the purpose of pricing the resource use is defeated. 

These analyses lead to two, rather undesirable, characteristics any successful pricing 
policy cannot be free from. First, some arbitrariness is unavoidable, since there exists, 
most likely, no universally acceptable solution to any of the problems above (e.g., how to 
measure overhead, how much overhead should a user be held responsible for). Second, 
a pricing policy, which is easy on the resources and the users, would be based on easy- 
to-identify resource usages. Pricing always alters user behavior towards using less of the 
highly priced resources. If the resources, whose uses are more easily measured compared to 
others, are not the ones which can be considered as representative of the entire computer 
use, the pricing scheme may skew user behavior in an undesirable and unpredictable way. 
More seriously, it is unlikely to be supported by the users. 

3.1.4 Mendelson’s Analysis of Pricing Objectives 

Mendelson [32] theoretically examined the objectives of pricing, in particular, the relation- 
ship between maximization of users’ value and the objectives often adopted by the admin- 
istration of computing facilities or the sole computer vendor (in the case where computing 
service, and not the computer which provides the service, is sold to the users), i.e., profit 
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maximization and cost recovery. Users had to decide whether to increase the computing 
load by taking into account disutility from a job’s waiting in a queue. We first summarize 
Mendelson’s results with respect to the service provider’s goals of profit maximization, cost 
recovery, and maximization of users’ value: The last one is incompatible with either of the 
first two. Subsequently, we discuss the reason why we cannot judge whether Mendelson’s 
scheme is an application of economics, as well as practicality of the proposed pricing. Al- 
though the service provider’s utility was set equal to the aggregate utility of the users, and 
the provider’s behavior was that of utility maximization, it is unclear whether the users in 
the scheme maximized utility. In addition, it is unlikely that the scheme met the scarcity 
and alternative-use clause in the requirement for economic applications. 

Profit Maximization, Cost Recovery, and Users 7 Value 

One of Mendelson’s results is that the value to users would not be maximized if access 
to computing resources is not charged. In other words, queueing is not self-regulating, 
therefore, the so-called free access leads to overloading. If usage is priced by a profit- 
maximizing authority (the situation is equivalent to monopoly pricing, in the most common 
case of one service provider per system), it leads to reduced utilization of the capacity, 
below the level that maximizes the net value to the users. He showed, in addition, that 
the investment decisions of a monopolist would result in a capacity lower than that which 
maximizes users’ value, given any utilization rate. 

Another reason for adoption of a pricing system, besides congestion alleviation, is the 
administration’s desire to recover costs through collecting charges. Neither does cost re- 
covery sit well with users’ value maximization. If there are no queueing effects and other 
externalities (i.e., activities that cause changes in utility levels, but without price), and if 
there is no change over time in cost per unit-time for each service capacity, the net aggre- 
gate user-utility is maximized when revenue is equal to cost, i.e., when budget is balanced, 
in Mendelson’s framework. However, if there are queueing effects, the disutility from or the 
cost of queueing would not figure into the provider’s budget. That is, net user- value maxi- 
mization, in the presence of disutility from queueing, would cause budget deficit. Finally, 
he claimed that from the point of view of maximizing users’ value, seemingly low utilization 
rates are often optimal, because of disutility caused by queueing. In sum, aggregate users’ 
value is not maximized when profit is maximized, or when cost recovery or high utilization 
rate is aimed at. 

Type of Users 

Naturally, Mendelson’s analysis was based on a set of assumptions regarding system be- 
havior. One of the assumptions that deserves special attention is the value of computer 
services. The first derivative of the aggregate users’ (gross) value of computing services was 
given as follows: V r (X) = p + v • W, where A is the arrival rate of jobs to the system, p is the 
price per standardized job, v is the delay cost per unit of time per job (or users’s willingness 
to pay for obtaining the processing results one time-unit earlier), and W is the time during 
which a job is expected to remain in the system. While this value function is meant for the 
system as a whole from the users’ perspective, the motivation behind the function is that 
of a single user. By defining the aggregate value of computing services as above, Mendelson 
assumed the existence of a representative user whose value was completely in line with 
that of the entire body of users . 18 Mendelson did not propose individual users’ utilities, 

18 In other words, the existence of a normative, representative consumer was assumed, which is a justifiable 
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hence, we cannot judge whether the existence of a representative user was derived from 
an admissible formulation of individual preferences and utilities. Accepting the aggregate- 
value function, the simplest situation, in which such a representative user can exist, is when 
the users are identical in all attributes (e.g., budget, jobs to run, and willingness to pay 
for obtaining the results earlier). Since the individuals’ utilities and their views of each 
other are unknown, we do not know whether each users’ utility was maximized through 
the scheme. No alternative use of budget was documented. Neither was the aggregate 
user-utility function a concave one. This suggests that the utility function for each user 
is also non-concave under the assumption that the users are homogeneous, an assumption 
implied by the motivation behind the aggregate function. These two observations point to 
the conclusion that the scheme did not satisfy the condition of scarcity and the existence 
of alternative-use to qualify as an economic application. 

Pricing 

The paper suggested to determine the price for running a job from the users’ value (F) 
and other variables (u and W) in the above equation, where the value of users’ time was to 
replace F. There are two problems to this approach. One is that the value of users’ time 
does not include the value from running a job, which is a major component in the value to 
be obtained from using a computer. Another is that the price is set so that the marginal 
aggregate-utility (i.e., V f (X) — p — t; • W, the marginal aggregate-gross- value minus the 
marginal aggregate-cost) is equal to zero. If the price is determined before job submissions, 
there is no guarantee that the user body would be such that its V 7 is identical to one that 
was used to calculate p. If the price is determined after job completion, there would be 
no such discrepancy, but one of the critical elements for a scheduler’s success, i.e., user 
autonomy [5, 39], would be eroded. 

3.2 Markets and Computer Networks: from early 1980s to present 

The word “markets” started to take the place of “pricing” in the 1980s, when computer 
networks became more common. When the users had access to only a single computer, 
pricing of computing resources meant price- setting by the sole service provider, who wished 
to alleviate congestion or collect expenses incurred by the computer. In contrast, a com- 
puter network consists not only of multiple users, but also of multiple service providers, 
appearing much more complex [44] 19 and closer to a market as we know from everyday life 
[3, 13, 20, 25, 33, 48]. 20 The seeming ease with which markets allocate resources, albeit 
its complexity [3, 13, 25, 33, 44], and the solid existence of theoretical microeconomics 
(the general equilibrium theory, in particular), whose results are derived mathematically 
[13, 25, 33, 44], have captured the imagination of researchers in the field of networks, 
including distributed computing systems. 

assumption only if certain conditions are met. For detailed discussions on this matter, see, for example, 
Section 4.D of Microeconomic Theory [29]. 

19 According to Stonebraker et al, “[t]he difficulty in scheduling distributed actions in a large system stems 
from the combi n at or i ally large number of possible choices for each action, expense of global synchronization, 
and requirement for supporting heterogeneous systems. Complexity is further increased by the presence of 
a dynamically changing environment, including time varying load levels for each site and the possibility of 
sites entering and leaving the system.” 

20 Around the time when the word “market” started to appear frequently in relation to distributed com- 
puting systems, a system based on markets was also proposed for manufacturing, which traditionally took 
a hierarchical approach [47]. 
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3.2.1 Systems of Focus 


We can distinguish two types of application of economics (be it named “pricing” or “mar- 
kets,” what we can hope to add to a system is the utilization of the economic motivation 
of users and service providers) to networks of computers, which may be termed distributed 
computer systems [42].' 21 One type concerns the Internet and the Asynchronous Transmis- 
sion Mode (ATM), where each job has a specific destination, and there are usually many 
possibilities as to routing, but the capacity of information transmission is fixed, at least in 
the short run. The primary purpose of pricing the services for such networks is to control 
the communication traffic so that the value from use of the infrastructure is maximized 
[26]. Routing configuration is one of the most important attributes in this case [8, 24]. 

The second type concerns networks of computers, which may not be identical, but 
with some common computing facilities that render them substitutable of one another. A 
system, in which several interconnected computers share the computing tasks assigned to 
the system, is defined to be a distributed computing system [21], which forms a part of the 
distributed computer systems as defined by Stankovic [42]. As far as users are concerned, 
there is no unique object to be obtained from each computer or destination, as is the case 
with the Internet and ATM. Although user- initiated dispersion of jobs over time may be one 
of the goals as it is for the Internet and ATM, the question of pricing arises not because of 
heavy traffic along the routes. The second type of network was conceived on the assumption 
that traffic would remain reasonably light and that sending a job to a geographically remote 
computer, which the user does not have direct control over, for execution would result 
in its earlier completion, than submitting a job to a local computer with direct control. 
Since the gains from early, and possibly faster, executions are supposed to Outweigh the 
inevitable increase in the amount of communication, the second kind of network make the 
configuration of networks of much smaller importance than it is for the first type. What 
markets are expected to do for the second kind is to make the best match between the job to 
be run and a computer, known as global scheduling. One of the most important problems 
in distributed computing systems emerges from the fact that jobs, as well as resources 
available at different times, are not homogeneous. Moreover, such networks are used mainly 
for research purposes, and pursuit of profits is very often considered an objective that runs 
counter to a productive research environment. The Internet and ATM, on the other hand, 
are run by commercial entities, whose survival depends on the profitability of providing 
services; pricing has an additional role of providing information for investment decisions 
[26]. 

Based on the above discussion, we conclude that the two groups of distributed systems 
aim for different goals through application of economics, and thus, should be considered 
separately. 22 We focus below on the second type of computer networks, or distributed 
computing systems, which are represented by the Information Power Grid [22], the National 
Technology Grid [36], and the EuroGrid [12]. 

21 Stankovic defined a distributed computer system to be “a collection of processor-memory pairs connected 
by a communications subnet and logically integrated in varying degrees by a distributed operating system 
and/or distributed data-base system.” 

22 For issues related to the Internet and flow control, see References [8], [10], [23], [24], [26], [31], [38], 
among others. 
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3.2.2 Why Markets? 

A keen interest has been shown in establishing a market of computing resources, which may 
match jobs and computers in the best way possible. The match arranged by the market is 
almost always judged desirable, without comparison with other possible matches. 

Some argue that we can overcome the difficulty of agreeing on the performance metric 
for distributed systems by employing markets [13]. 23 In addition, markets are claimed to 
possess many useful characteristics, such as simplicity [13, 20, 25], 24 flexibility [7, 33, 44], 
efficiency [33] (or the ability to achieve Pareto-optimal allocations under certain conditions 
[50]), dynamic adjustability [20, 44], scalability [3], sparsity of required communication 
(which stems from the existence of price) [7, 20, 33, 49], the ability to meet the global 
objective (when market participants pursue their own local goals) [3, 7, 33], compatibility 
with object-oriented programming [33, 50], while it has been acknowledged that empir- 
ical confirmation of such claims is necessary [49]. Markets’ other desirable features are 
attributed to their decentralized nature. Some consider a decentralized system superior to 
a centralized system by definition [33], while others see a great possibility of controlling a 
distributed system using a decentralized method [20, 25, 28, 41, 48, 49, 50]. Decentralized 
systems are said to be better suited for large systems [13, 33, 45], easy to design and im- 
plement [7, 13, 45, 50], scalable [44] (or extensible [41]), devoid of a single point of failure 
(contrary to centralized systems) [25, 28, 44], speedy [41], and reliable [41]. The representa- 
tive market models for distributed computing systems are: the Contract Net Protocol [41], 
the Enterprise [28], a model by Kurose and Simha [25], Agoric System [33], Spawn [20, 48], 
WALRAS [6, 49, 50], Mariposa [44, 45], and the Grid Architecture for Computational Econ- 
omy [3]. 25 All of these models employ, or appear to have in mind, artificial agents, which 
acquire computing resources on behalf of the users; they are multi-agent systems. Below 
we provide discussions on these models. 

3.2.3 The Contract Net Protocol 

We examine the information exchange process in the Contract Net Protocol [41], which does 
not appear too different from that in a non-distributed computing system, if evaluated 
according to the characterization provided by the author of the protocol. Many of the 
details necessary for implementation were left unspecified, including agents’ utility; we are 
unable to conclude that the protocol is an economic application. 

Bidding and Negotiation 

As summarized by Tilley [47], the Contract Net Protocol “is a conceptual design for a 
method of task allocation to nodes which can perform the tasks within a distributed com- 
puting system.” It is a model with artificial agents in which a manager node (a type of 
artificial agent) broadcasts the task to be carried out and contractor nodes (another type 

23 Ferguson et al. [13] argued: “Traditional approaches attempt to optimize some system- wide measure of 
performance (e.g., average response time, throughput). • ■ • The current and future complexity of resource 
allocation problems described above makes it impossible to define an acceptable system-wide performance 
metric. • • • Most economic models ■ • • The performance criteria of the system as a whole is determined by 
some combination of the performance criteria of the individual agents.” ^ 

24 For some, it is not clear whether “the market approach offers any advantages in overall complexity” 

25 In citing such models, those for database systems that assume light traffic, are often included, e g., 
Mariposa. 
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of artificial agents) bid for the task. The manager node evaluates the bids and decides the 
contractor that is to be awarded the task. Such exchanges of information were together 
termed a negotiation process, which is an unfortunate name choice. If it were a negotiation, 
a task request should be modified upon rejection by a contractor, in line with the feedback 
given by that contractor, and resubmitted to the same contractor. Instead, the request is 
sent to as many contractors as possible, and the sender waits for a bidder who considers 
the request acceptable. The protocol does not concern negotiation. 

Characteristics of the Information- Exchange Process 

Smith [41] identified four important components in his information exchange process: (i) 
lack of centralized control; (ii) two-way nature; (iii) evaluation of information by local 
entities; and, (iv) finalization by mutual agreement. These features are not unique to 
Smith’s scheme, and most of them axe also found in scheduling mechanisms for systems 
with a single computer. When various time segments are priced differently, co mm unication 
takes place; the preference of the service provider, with respect to the timing of users’ job 
submission, is conveyed to the users. The users evaluate the information (i.e., price) in 
order to decide when to submit their jobs, and by submitting a job for particular time 
segments they communicate their preferences under that price. Hence, although it may not 
be as explicit as the one in the protocol, pricing always entails two-way communication and 
evaluation of information by local entities. Moreover, as it is the users who decide which 
time segments to demand, given the differentiation of them by the service provider, the 
allocation of time segments is determined through mutual consent. Therefore, the listed 
components, except the first one, are the features also shared by a pricing scheme for a 
system with a single service provider. Note that it..is not possible to bypass a computer when 
there is only one in the system. The supporting organization of such a computer is usually 
considered the central authority, and to the extent that many decisions involve the caretaker 
of the sole computer, central control is unavoidable for a system with one computer. Thus, 
it is quite natural that we do not find Smith’s first feature in non-distributed systems. 

The Goal of the Protocol 

The formats of a task and a bid, as well as their evaluation method, were not specified in the 
protocol. The resultant matches will vary, depending on their specifications, which are in 
turn dependent on the objectives of the manager and the contract nodes. How accurate the 
task description and the bid contents would be, or how much of private information would 
be revealed through communication, is also dependent on the specifications. Thus, it is 
not clear which goals for distributed systems could be supported by the protocol, although 
some match would probably be achieved. Additionally, the utility of nodes was not taken 
into consideration in drawing the scheme, the presence of which is required for the economic 
motivation to be at work. We cannot conclude, without further details of implementation, 
whether the protocol simply borrows terminology from economics (e.g., bidding), and has 
no further bearing on economics, or it is driven by some economic force. 

The Contract Net Protocol is a blueprint for a matching mechanism between jobs to 
be executed and hardware for their execution. It has shown researchers the possible ap- 
plications of economics in global scheduling. The novelty lies in that fact; it has directed 
our attention to a possible use of economics in distributed systems. We need more work on 
how various approaches to the scheduling problem, including the protocol, relate to each 
other [47], before we conclude that economics is useful in scheduling. 
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3.2.4 Enterprise 

The Enterprise system [28] is a fleshed-out version of the Contract Net Protocol, which 
connected personal workstations, using a local area network. Although favorable simulation 
results were reported, we cannot attribute them wholly to the scheme s general features. 
Neither can we conclude that the scheme is an application of economics, because the utility 
of the service providers in the scheme was undefined. There was no mention of user budget, 
without which we cannot evaluate whether the scarcity and alternative-use condition for 
users was satisfied. 

Member of the Contract Net Protocol Family 

A request by a client (or a manager, in Smith’s [41] terminology) for bids contained the 
numerical priority of the task, special requirements, and information of the task that al- 
lowed processing-time estimation. 26 A response by a potential contractor to a request, i.e., 
a “bid,” contained either an estimation of completion time or an acknowledgement message 
(if it happened to be executing a job at the time of receiving the request). The evaluation 
criterion was how soon the completion was expected to be; the contractor with the shortest 
processing-time won the task. That is, the clients’ utility was the negative value of expected 
job-completion time, provided that they maximized utility. For the reported simulation, 
minimization of the mean flow-time of jobs was chosen as the scheduling objective. Thus, 
the shortest-processing-time-first scheduling was considered optimal among the available 
heuristics. We note that the scheduling objective has no logical connection with the objec- 
tive of the contractors (i.e., the service providers), unlike in a non-distributed system where 
the sole service provider is the scheduler. 

In order to prevent the clients from reporting underestimated processing times for ob- 
taining earlier spots for their jobs, tasks were aborted if they exceeded the time specified 
by the “estimation error tolerance” parameter. 27 

A client waited for a certain time after sending a request and before engaging in an 
evaluation. 28 If no bid was received by the time of evaluation, the first bidder won the 
task. A later bid was considered, if it was “significantly better” than that of the tentative 
winner. These measures were put into place in consideration of unpredicted delays and 
losses in message exchange. Cancel messages were sent to all bidders who did not win the 
contract. 

A simulation was carried out on ten various configurations, each of which had exactly 
eight units of processing power. Jobs were assumed to be independent of one another, 
processable on any workstation in the network, and 1,200-75,000 of them arrived according 
to a Poisson process. Their size was assumed to be exponentially distributed. The exam- 
ined settings differed with respect to the accuracy of job processing-time estimates, delay- 
in message transmission, the system utilization level, 29 and the “late bid improvement” 

26 As one of the implementation examples, Malone et al. [28] reported a task description which contained 
the following information: the estimated processing time on a “standard” processor, and the names an 
lengths of the files to be loaded before processing. The estimated processing time was expected to be 
provided by the user. If not, the default value was employed. The time for file loading was estimated to be 

proportional to the length of each file. ^ 

27 This measure does not enforce honest reporting of estimates. Rather, it encourages reportings of honest 

estimates minus the permitted error. 

28 The client’s own bid for task execution was not processed for a certain time period so as to give time 
for bids from other workstations to arrive. 

29 The rate of system utilization was defined as the expected amount of processing requested per time- 
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parameter. The same sequence of random numbers was used for job generation for each 
simulation. 

Market-Like Task Scheduler 

As the title of the paper admits (“Enterprise: A Market-like Task Scheduler for Distributed 
Computing Systems” [28]), the Enterprise scheduler does not quite involve a market. What 
was christened as a bidding process involved revelation of local information, or information 
privately held by the job-executing machines, but there was no reward to the machines from 
winning the bids. Since the service providers’ utility was not part of the framework, there 
was no increase in the utility of the machines, or that of the owners of the machines, when 
a bid won. No incentive existed for the machines to report the best possible completion 
time and obtain a contract. Bidding was a form of information exchange, which was not 
motivated by gains in trade of scarce resources. In short, we cannot conclude that the 
machines behaved in a utility-maximizing way, and the scheme does not appear to have 
relied on the economic motivation. 

Load, Time Estimates, Number of Machines, and Message Delay 

We now examine the conclusions from the simulation results. The positive relationship 
between the system load and the mean flow-time is as expected. A heavier load means that 
there are fewer machines available at a time and over time, forcing each job to stay longer 
in the system. 

The second conclusion that the inaccuracy in processing-time estimates has minimal 
effects on the mean flow-time is most likely not unique to the specific features of the 
Enterprise. If there had been only one computer to execute the jobs, the estimates would 
have been of crucial importance in the shortest-processing-time-first scheduling. However, 
the distributed system executes as many jobs as there are workstations in the network at 
the same time, rendering the priority of smaller importance. If there are n workstations in 
the network, it is desirable that every set of approximately n jobs is prioritized according 
to accurate estimates, but how jobs are prioritized within each set is of much sm all er 
importance than it is under a non-distributed system. This holds for any distributed 
computing systems, whose computers are capable of executing any job that arrives. Under 
a low system-utilization rate, the mean flow-time with inaccurate estimates was smaller 
than that with perfectly accurate estimates. This is probably due to the fact that the 
shortest-processing-time-first strategy is simply a heuristic for minimizing the mean flow- 
time. 

The third conclusion is that the mean flow-time is not reduced when more than 8-10 
machines are added to the network, under the assumption of perfect communication. If 
there were message delays and losses, it is expected that the optimal n um ber of machines 
per network would be smaller. The study reported that there were benefits from network 
formation only at moderate and high utilization rates, and only if the number of machines 
was less than eight. The reason for hitting the ceiling at eight machines per network was 
not given. 

It was also concluded that message delays have little detrimental effect on the mean 
flow-time, where each delay was introduced as a fixed percentage of the average task- 
processing-time. All messages were delayed for the same amount of time, hence, the time 
required for communication was monotonically transformed, resulting in the same order 

interval divided by the total amount of processing power in the system. 
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of message arrivals. Thus, the mean flow-time could be delayed only by the extent of the 
tardiness of messages, and not because of less-than-optimal scheduling that would be caused 
by more general kinds of message delays. 

As the paper pointed out, the cost of rescheduling upon the late arrival of a “significantly 
better” bid included the time elapsed since the start of processing by the tentative bid- 
winner. 30 The delay in executing the job, which replaces the one partly executed by the 
tentative bid- winner before rescheduling, may also be considered part of that cost. In either 
case, the cost increases as the utilization rate increases, and therefore, makes the benefit 
of rescheduling shrink when the utilization rate is high. In sum, the desirable results 
observed seem to owe to the features of the Enterprise that are not related to the economic 
motivation. Some owe also to the special setting of the simulation. 

3.2.5 Model by Kurose and Simha 

The paper by Kurose and Simha [25] is one of the oft-cited papers on distributed computer 
systems with relation to economics. We briefly discuss the general equilibrium theory, 
which their model draws on, with attention to the so-called tatonnement process and the 
problematic aspects of the process (i.e., the presence of an auctioneer and incentive incom- 
patibility). While the second type of scarcity existed for the artificial agents representing 
nodes in the model, they were not utility maximizers, disqualifying the model as an appli- 
cation of economics. The utility of the resource allocator, called auctioneer, was undefined, 
as is the case for auctioneers in the general equilibrium theory. 

General Equilibrium Theory and Resource- Directed Approach 

Kurose and Simha implemented one of what they call the two basic microeconomic ap- 
proaches, the price-oriented and the resource-oriented approaches, which are better known 
as a tatonnement process (for reaching an equilibrium) with pure price adjustment and that 
with pure quantity adjustment, respectively. 31 Hence, the model by Kurose and Simha 
draws on the general equilibrium theory in economics, a theory that concerns price and 
quantity determination in equilibrium initiated by Leon Walras in the late 19th century. 
The economy under consideration in the general equilibrium theory is one in which the 
number of agents in the system is large enough so that any one of them cannot affect prices 
by acting alone, and agents do not collaborate. In other words, all participants in the 
economy, producers and consumers, are price-takers. Such an economy is often interpreted 
either as a market economy that is perfectly competitive or as a planned economy. The 
model by Kurose and Simha is based on Heal’s [15], which adopted the latter interpretation. 

In an exposition of the standard tatonnement process with pure quantity adjustment, an 
economy with production is usually considered [15, 29]. There is an auctioneer who informs 
profit-maximizing producers of their entitled quantities of inputs, and the producers report 
back the marginal productivities at those quantities. Upon receipt of the information from 
the producers, the auctioneer changes the allocation so that more inputs are allocated to the 

30 The improvement parameter, i (which was defined to be 1 — ( — t)/(tE — t), where ts is the estimated 
completion time in the earlier bid, tt is the estimated completion time in the late bid, and t is the time 
at which the late bid is evaluated), provided the threshold for accepting or rejecting a late bid. Late bids 
needed to exceed the value of i chosen in order to be accepted. 

31 In connection with the two approaches, some information sources in economics were given [2, 15, 19]. 
However, the two approaches do not appear in the citations by the names given by the authors. Hurwicz’s 
[19] tentative naming of the processes, “price-guided” and “quantity-guided,” appear to have been adopted 
with a slight change. 
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producers with higher marginal productivities. The process is repeated until an equilibrium 
in price and quantity is reached. 32 In the context of distributed computer systems, there 
are no producers, and we need to alter the scenario as follows. The auctioneer informs the 
utility-maximizing agents of their entitled quantities of resources and the agents report back 
the marginal utilities at those quantities. The auctioneer changes the allocation of resources 
so that more inputs are allocated to the agents with higher marginal utilities. The process 
continues until an equilibrium in price and quantity is attained. 33 This is the approach 
preferred and adopted by the authors, because all interim allocations are feasible, unlike 
the price-oriented approach. 34,35 We note that the process does not guarantee convergence 
to a unique equilibrium, even if one exists, without further restrictions on the economy. 

Another attractive feature of the resource-directed approach was reported: “When an- 
alytic formulas are used to compute performance, successive iterations of the algorithm 
result in resource allocations of strictly increasing systemwide utility.” 36 Put differently, 
optimization by local agents led to an optimal solution for the entire system because the 
global utility was set equal to the sum of utilities of local agents. Consequently, the global 
objective function was a function only of local objective functions increasing in all of its 
arguments, and unresponsive to the names of the local agents; local optimization coincided 
with global optimization. The iterations in resource allocation conform with the economic 
motivation only if successive allocations do not lead to lower utilities for all agents con- 
cerned. If any of the agent’s utility is to be reduced through another round of transaction, 
that agent is better off by not participating in the exchange. Thus, the feature is equivalent 
to economic feasibility of each iteration in the adopted framework. 

The two advantages described above, feasibility (in a discrete process) and monotonicity, 
were labeled two desirable properties of tatonnement [27]/gradient [19j-based processes 
for reaching an equilibrium, by Malinvaud. He was concerned about the possibility of 
slow or “disorganized” convergence to an equilibrium, which implied that the existence 
of an equilibrium and convergence to one through a tatonnement process, by themselves, 
do not guarantee practicality of the process as one in economic planning. Kurose and 
Simha proposed algorithms which were based on a tatonnement process with pure quantity 
adjustments. Theoretical investigation of their most basic algorithm by Heal [15] had shown 
that it indeed exhibits both properties. For the process to function, however, a condition 

32 Since the producers axe profit-maximizing, the ratios of marginal productivities (or the marginal rates 
of transformation) are equivalent to shadow prices (or the prices at which the profit-maximizing producers 
are willing to accept the proposed allocation of resources) in an economy with production. 

33 Since the agents axe utility-maximizing, the ratios of marginal utilities (or the marginal rates of sub- 
stitution) axe equivalent to shadow prices (or the prices at which utility-maximizing agents are willing to 
accept the proposed resource allocation) in a pure exchange economy. 

34 See Section 3.2.7 for an application of the tatonnement process with pure price adjustment. 

35 The title of HeaTs paper, on which the model is based, is somewhat misleading: “Planning without 
Prices” [15]. What Heal meant by “without prices” is that in a planned economy, where all resource- 
allocation decisions are made by the central planner, the planner works directly with marginal productivities 
(in a production economy, or marginal utilities in a pure exchange economy) reported by local agents. Heal 
implicitly assumed producers to be profit-maximizing, in which case the ratios of marginal productivities 
(or the marginal rates of transformation) are equivalent to shadow prices (or the prices at which the profit- 
maximizing producers are willing to accept the proposed allocation of resources). 

36 Heal [15] concluded that in the tatonnement process with pure quantity adjustment (or the resource- 
oriented approach, according to Kurose and Simha) more information exchange would be required than in the 
process with pure price adjustments. Hurwicz [19] pointed out that the total information would be of higher 
dimension in the process with pure quantity adjustment (or the “quantity-guided” mechanism, according 
to Hurwicz) compared to the process with pure price adjustment (or the “price-guided” mechanism), but 
also added that whether the difference was significant was “somewhat controversial.” 
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has to be met: the central authority’s knowledge of an initial allocation that is feasible, 
which is the cost of obtaining the desirable properties (i.e., feasibility and monotonicity) 
according to Hurwicz [19]. 

Optimal File Allocation 

The distributed system chosen for investigation was a network of nodes, which were assumed 
capable of communicating with any other in the network. The problem was to allocate files 
optimally. Each node had a local look-up table, which provided information on the file 
fragment locations so that a request not met locally could be sent to an appropriate node. 
We could view each node as an artificial agent of the system. The cost of communication 
to each node was defined to be the average delay in the transmission of messages. The 
cost of access delay was defined to be the expected time in access delay. In turn, the sum 
of the cost of communication and the cost of access delay was called the expected cost of 
access to the file source at a node. Therefore, allocating all files at one node may reduce 
the cost of communication, but only by increasing the cost of access delay, because that 
mode must handle all inquiries in the system. The expected cost of access to the entire 
network was the sum of the expected cost at each node. The optimal file allocation was 
taken to be the allocation that minimizes the expected cost of access for the whole network. 
In order to cast the problem as a utility maximization problem, the utility was set equal 
to the negative of the expected cost. 

The performance of three decentralized algorithms was examined, using 19 nodes and 
allowing them to generate access to file resources at a rate determined by a Poisson process 
(with its parameter equal to unity, the inverse ot the number of nodes, etc.). They all 
employed gradient processes; each node computed the first derivative of the utility function 
(i.e., marginal utility) and/or the second derivative, evaluated at a specific point, and sent 
that information to the central node (or alternatively, to all other nodes). The termination 
criterion was that the marginal utilities of all nodes in the network be sufficiently close. 
When the criterion was not met, the files were reallocated so that the difference in marginal 
utilities would be smaller. The paper concluded that all algorithms, which were discrete- 
time processes, had the following desirable properties: feasibility in all iterations, strict 
monotonicity, and fast convergence. 

Problems in General Equilibrium Theory 

There are some serious problems in the general equilibrium theory, in connection with 
tatonnement processes. One is that it is devoid of a price formation mechanism under the 
market-economy interpretation [1]. Prices are adjusted by an auctioneer until an equilib- 
rium is reached, but there is no real-world counterpart to such an auctioneer in markets. If 
we consider a planned economy, the role of the auctioneer can be thought to be presumed 
by the central planner. The second approach is the one taken by HeaPs model [15], on 
which the model by Kurose and Simha is based. The second interpretation is not free of 
problems if the system is to be called a decentralized one, as Heal [15] and Malinvaud [27], 
among others, did. The presence of a central planner makes it difficult to claim that the 
model is that of a decentralized system, which functions without central directives, as is 
assumed by many who are engaged in applying market mechanisms to the allocation of 
computing resources. HeaPs model involved reporting of preferences, but no local decision- 
making with respect to available choices. In other words, it was decentralized only in the 
sense that information was collected from the local agents. The same holds for Malinvaud’s 
decentralized process. As far as planned economies are concerned, it may be legitimate to 
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name such an economy a decentralized and planned one, as opposed to a planned economy 
in which all economic activities axe determined by the central planner without any feedback 
from the local agents. The mechanisms employed by Kurose and Simha for adjustment of 
the system towards an equilibrium are informationally decentralized [19], but that is not 
equivalent to decentralized decision-making. 37 Indeed, the processes do not concern local 
decision-making, just as HeaPs model does not. In sum, a decentralized economic planning 
does not truly qualify as a decentralized system with features such as lack of a single point 
of failure, as envisaged by many of the researchers in the field of global scheduling. 

Another problem in the general equilibrium theory is also carried over to the model 
by Heal as well as to that by Kurose and Simha: incentive incompatibility. Although 
reporting the derivatives of the pertinent functions to the central authority is one of the 
standard elements in the tatonnement processes, its incentive incompatibility has been 
established only when the number of traders is infinite [18]. Note that individual nodes 
could have increased the final utility by falsely reporting the levels of marginal utility 
that were above the actual levels. No mechanism was in place to prevent the nodes from 
resorting to such an action. However, the local agents in the investigated network acted so 
as to fulfill the global goal, i.e., minimization of expected access cost to the entire system, by 
forgoing the opportunity to increase their own utilities. That is, a distributed algorithm is 
not synonymous with distributed decision-making or a decentralized system, which implies 
utility maximization by economic agents. Finally, the utility of auctioneers is always ignored 
in the general equilibrium theory, and so it is in the models by Heal, Kurose and Simha. 

The above discussion also serves as an analysis of whether the resource allocation scheme 
was driven by economic -considerations of the agents in the system. The model. relied on 
nodes’ balancing the benefits and the costs of owning a file fragment; the second type of 
scarcity (and hence, the existence of alternative uses in the broad sense) was present. The 
fact that the nodes reported their marginal utilities honestly to the central node (or, to all 
other nodes), in face of feasible cheating and attainment of higher utility, indicates that the 
nodes were not utility-maximizing agents; the first part of the necessary condition to be an 
economic application was not met. The utility of the auctioneer, an active participant in the 
resource allocation process, was left undefined. The study neither validates nor invalidates 
the appropriateness of creating markets for computing resources in distributed systems. 

3.2.6 Spawn 

Spawn [20, 48] is a resource allocation mechanism for a network of heterogeneous worksta- 
tions whose agents are sellers (i.e., owners of workstations, who are not using them at any 
given moment) and buyers of CPU time. Human users do not directly participate, making 
the system a multi-agent one. The special feature of Spawn is its spawning process or 
dividing a task into subtasks. We examine the pricing mechanism, which involves auctions, 
and the global objective of Spawn. The examination does not lead us to conclude that 
Spawn is an application of economics. The artificial agents’ utilities (that of both buyers 
and sellers of computing resources) were not defined; it was impossible to confirm that the 
scheme satisfied the necessary condition to be an economic application. 

Spawning Concurrent and Independent Tasks 

37 An informationally decentralized process is one which has informational requirements that are no greater 
than those for a perfectly competitive process [18]. 
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In the reported implementation [48], a buyer bid for an idle machine, which was devoted 
to a single winning buyer. A sealed-bid, second-price auction was employed, 38 where a bid 
contained the length of time desired, the quantity of funds, and a brief task description [48]. 
The budget for each task was determined by its relative priority [20]. In the most general 
case, whether a task is divisible must be checked, and if so, information on how it can be 
divided so that the resultant tasks would be suitable for execution by separate machines, 
what kind of resources each divided task would require, etc., should be communicated to 
the system for a successful spawning. These problems were avoided by tailoring the system 
to handle concurrent and independent tasks, and this feature set Spawn apart from systems 
such as Condor [48]. When subtasks were spawned, the budget for the original problem 
was transferred to the subtasks at a constant rate, and the budget unused was kept by the 
subtasks [20]. Each subtask adopted the strategy to bid all financial resources at every 
auction [20], and that strategy gave a bigger chance of winning for a subtask that had been 
losing in auctions for a longer time. The simulation example concerned asynchronous Monte 
Carlo applications, which were executed concurrently in a network of idle workstations. The 
number of nodes employed ranged from 6 to 64, and that of trials per second ranged up to 
100,000. The overhead was observed to be relatively small. 

Funding as Dynamically Determined Priority 

We first examine how auctions in Spawn functioned. As was implied in a later paper [20], it 
was optimal for the subtasks to place all funds accumulated as a bid in any auction, because 
there was no other use for funds and because auctions in general do not financially penalize 
the losers. 39 Therefore, any winning bid was equal to the entire funds owned by the winning 
subtask at the time of bidding. Waldspurger et ai [48] reported that the resources were 
allocated in a way that reflected the funding ratio in all runs: a fair allocation, according 
to the authors. Subsequently, fair allocations were not due to the auction mechanism by 
itself, but more due to the applicability of funds that was limited to one task. By allowing 
unused budgets to accumulate and by setting up the game so that the bidder with the 
biggest budget would win, the funding did not simply reflect the original relative priority, 
but one that was dynamically adjusted [48]. This ensured that no unexecuted job is left 
with a small probability of winning resources when all others are completed [20]. Thus, 
the role of auctions in Spawn was to communicate the dynamic priority of jobs, which was 
completely determined by the remaining budget, to resource sellers. 

The Role of Price 

We now turn to the role of price in Spawn. In the description of the spawning procedure, 
there is an indication that subtasks were spawned to machines that were close to the 
originating machine of the task in the network, and not to all machines in the network 

38 A sealed-bid, second-price auction was chosen so that repeated communication, such as that in an 
English auction, would not be required. Huberman and Hogg [20] further added: “More importantly, this 
mechanism avoids gaming of the system by the agents — for example, by strategically driving up the winning 
price so that alternative users exhaust their resources more quickly ...” For this assessment to hold true, 
the expected winning bid in the sealed-bid, second-price auction must be lower than that in the English 
auction for the same item. That is true under restricted conditions. For detailed discussions on this issue, 
see, for example, “Auctions and Bidding” [30]. 

39 Huberman and Hogg [20] described the bid employed by Spawn as follows: “The amount of the bid was 
based on two pieces of information: the intrinsic speed of the machine to complete that task and how much 
money the agent had.” It was not described how the information on speed could be communicated or in 
which way it influenced the bid. 
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[48]. It is not clear, however, which course of action was taken upon losing in an auction: 
whether the subtask waited at the same machine for its fund to accumulate or ventured 
further in the network for a machine whose service could be bought with the funds available 
at that time. Hence, we do not know the mechanism which “permits concurrent Spawn 
applications to adaptively expand into more machines when prices are low, and forces them 
to contract into fewer machines when prices are high” [48]. 

There was no knowing beforehand which machine would be offering services cheaply. 
Recall that bids were synonymous with budgets, which were in turn equivalent to priorities. 
Therefore, the winning price depended on the levels of priority given to jobs that asked for 
the use of a particular idle machine. Moreover, the communication mechanism of Spawn 
was such that jobs of which priority would be coveting the same idle machine could be 
revealed only through an auction. As a consequence, the situation in which “rich agents 
were all found to be bidding on very few machines while others were idle” in a sparsely 
connected network [20, 48] could not be avoided; some of the fundamental structures of the 
system have to be changed, if such situations were not to be encountered, as was conjectured 
[2°]- 

We are not led to the conclusion that price acted as a guidance for better resource 
usage. As was analyzed above, all bids were equivalent to dynamically adjusted priority 
of jobs. Since the optimal strategy was to bid all the funds at hand, the price at which 
the resource in question was traded, was always equal to the amount of funds owned by 
the job with the second highest priority. Therefore, price at any time is nothing more 
than a reflection of two machines that were close to an idle machine and had the highest 
priorities. Our interpretation of price in Spawn conforms with one of the experiments 
reported [48] . Instead of funding the spawned jobs equally, the ones which were “running 
on the cheapest few machines were given the funding.” This amounted to increasing the 
priority levels of jobs if the previous winning bid had been low. Considering the funding and 
the auction structures of Spawn, higher rates of funding transfer make a higher winning- 
bid, and hence, a higher winning-price more likely. This analysis matches with their result 
of the experiment: “This strategy eliminated the price difference[.]” 

The Global Objective and the Economic Motivation 

The global objective of allocating machines to jobs in a fair way, which, in the framework, 
was to allocate them to jobs with higher priorities [48], is in essence always met if there are 
more idle machines than there are subtasks. If the number of idle machines is smaller than 
that of subtasks, whether Spawn would grant resources to the jobs with the highest priorities 
depends on how closely located the jobs with highest priorities are in the network. When 
the highest priority jobs are close to each other, some jobs, which should not be granted 
resources before other subtasks from the point of global ordering of job execution because of 
their low priority, may be given resources [48]. Differently put, the attainment of the overall 
objective has more to do with funding of various subtasks and how the originating machines 
of the subtasks are located relative to each other than with each subtask’s motivation. 

Since the agents’ goal or utility remains unknown, we cannot judge whether the scheme 
is an application of economics. As was the case with Sutherland’s scheme described in 
Section 3.1.1, a budget was specified for each job, and there was no use for funds except for 
buying computing resources within the system. There was no incentive for the bidders in 
Spawn to search for cheaply priced resources so that the remaining budget could be used 
for some other purposes. We note that prioritizing becomes redundant if there are more 
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machines than the number of spawned jobs. Finally, it is not known whether Spawn was 
better than other methods in meeting the global objective. 

3.2.7 WALRAS 

WALRAS, like the model by Kurose and Simha, is an application of the general equilibrium 
theory to scheduling [49]. It implemented the tatonnement process with pure price adjust- 
ment, through which an equilibrium in the economy is reached, while Kurose and Simha 
opted for that with pure quantity adjustment. 40 We provide a summary of the tatonnement 
process in WALRAS, which is different from the standard process, and the implications of 
the functional form of the users’ utility, in terms of the existence of an equilibrium, its 
uniqueness, and convergence to the equilibrium. There were several goods that affected the 
user utility (satisfying the existence-of- alternatives condition), but WALRAS is incentive 
incompatible, as any model based on the general equilibrium theory with a finite number 
of agents would be; it is unsuitable to be called an economic application. User budget was 
undefined, whereas the service provider acted so as to maximize utility. We do not know 
how well the homogeneous agents in the scheme may represent a heterogeneous body of 
users in reality. 

General Equilibrium Theory and WALRAS 

In the standard tatonnement process with pure price adjustment, there is an auctioneer 
who informs agents of the prices, and the agents report back the amounts of goods they 
demand (or more precisely, demand for goods over and above the amount endowed) at those 
prices. Such reports are called bids. The auctioneer calculates the new prices, according to 
the predetermined rules and the amounts of demand reported, and the process repeats until 
the prices no longer need to be adjusted. Unlike other schemes for distributed computing 
systems with biddings, the general equilibrium framework does not allow different prices 
for goods if they are considered the same and are traded in the same time-period. The final 
price in the tatonnement process with price adjustment applies to all units of the same 
good. 

Non-Standard Tatonnement Process 

WALRAS differed from the standard tatonnement process in that demand functions were 
reported by the agents (instead of a point on a demand function) and that the auctioneer 
dealt with each good separately [6, 49]. Moreover, not all agents reported their demands 
for all goods in each time period [6]. Random draws, which were independent across 
time and agents, determined which bids were submitted. For the unselected combinations 
of agents and goods, the bids from the previous period were used. The advantage of 
their asynchronous bidding was small price oscillations [6, 50]. Again, the agents which 
participated in the biddings were not human users, and hence, the scheme was based on 
artificial agents. Cheng and Wellman [6] favored their approach over other processes for 
attaining an equilibrium in the general equilibrium theory, since there was a smaller room 
for strategic interactions and no trade took place until an equilibrium was achieved (no 
resource was allocated based on intermediate results, which were by definition not global 
optima and may have been irreversible if implemented). The utility function of the resource 

users, u(x), was of constant elasticity of substitution: u(x) = a j ( x '’) p ') ) w h ere a j’ s 

40 See Section 3.2.5 for an application of the tatonnement process with pure quantity adjustment. 
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were randomly generated coefficients from a uniform distribution, x i was the amount of 
good j, and p was fixed at 0.5. Therefore, the resulting excess-demand functions, for each 
agent and for the entire economy, had the property of gross substitutability [6], i.e., there 
were no strong complementarities among the goods [29]. The existence of an equilibrium was 
guaranteed by the preferences implied from the utility functions (which were continuous, 
strictly convex, and locally nonsatiated) and non-negative total excess-demand (as Cheng 
and Wellman implicitly demonstrated with experiments). 41 Moreover, gross substitutability 
ensured the uniqueness of equilibrium and convergence to that equilibrium point on any 
price path. While the adaptive learning behavior of the auctioneers justified the rules of 
WALRAS, users remained simple price-takers who reported their excess-demand functions 
honestly. The users would not have reported the true demand functions if they acted so as 
to maximize utilities. This problem was also found in the model by Kurose and Simha. 42 

Convergence and Other Problems 

While WALRAS has been used for several distributed multicommodity-flow problems [49, 
50], we concentrate here on the most comprehensive results given in “The WALRAS Algo- 
rithm” [6]. An examination of 100 randomly generated economies, with five or seven agents 
of preferences as described above (where j is equal to 5), showed that the median behavior 
of the system was a rapid convergence to the equilibrium at the beginning, and leveling 
off at a small, positive amount of total excess demand after 150 iterations. When values 
other than 0.5 for the substitution coefficient were adopted, convergence was not seen even 
after 5,000 iterations in some cases. Equilibria reached through tatonnement processes in a 
framework as the one adopted by WALRAS are Pareto-optimal, which are often interpreted 
as desirable allocations [50]. 

For the feasibility of the proposed algorithm, it is imperative that it promises conver- 
gence to an equilibrium. Singularity of equilibrium is convenient,- since it spares us from 
the need to compare equilibria and further guide the system to the most desirable one. 
These favorable properties are obtained only under restricted circumstances, as the au- 
thors pointed out [6]. For such a well-behaved tatonnement process, we need restrictions 
on the agents’ utility functions. Gross substitutability of the aggregate excess-demand 
function is a sufficient condition, and the authors reported that they could not find a class 
of utility functions that are not grossly substitutable and yet converge to an equilibrium. 

Whatever the necessary conditions may be for convergence, and possibly for uniqueness 
of equilibrium, the utility functions employed must represent the preferences of users. The 
framework adopted utility functions with constant elasticity of substitution among multiple 
goods, but we do not know whether such utility functions reflect the preferences of users 
in distributed computing systems. WALRAS explored the case where every agent had an 
identical utility function. How it would serve a system of users with various utility functions 
and how it would compare with other scheduling mechanisms are yet to be seen. 

3.2.8 Mariposa 

Mariposa is a distributed database and storage system for non-uniform, multi-adminis- 
trator, wide area networks [44, 45]. We argue below that some of the advantages of markets, 

41 See Figure 1 in “The WALRAS Algorithm” [6]. 

42 No process that leads to Pareto- op timed equilibria is incentive compatible in a pure exchange economy 
with a finite number of agents, unless the endowments of the agents are forcibly exchanged before the process 
starts [19]. 
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which are claimed also as those of Mariposa, do not hold unconditionally, and question the 
practicality of the objectives chosen for the artificial agents. Some, but not all, of the 
agents’ objective (and thus, utilities of some agents) were proposed. We could not conclude 
that the scheme did not satisfy the necessary condition for being an economic application. 

Unconventional Features of Mariposa 

The work was motivated by the observation that non-uniform, multi-administrator, wide 
area networks require the following features [44, 45], which traditional distributed database 
management systems, according to the authors, cannot inherently possess [45]: scalability, 
data mobility, lack of global- synchronization requirement, total local autonomy, and config- 
urability of policies. The adoption of economics was considered desirable because it allowed 
a large number of sites in the network and locally made decisions (which permitted data 
mobility and made global synchronization unnecessary). Policy changes were to be easy 
with Rush, the language used by Mariposa [45]. Finally, scheduling complexity was to be 
reduced by applying economics, where an “invisible hand” would make trading of resources 
“reasonably equitable” [44, 45]. 

For the “invisible hand” property to be present, there must be enough agents in the 
system so that each agent correctly sees individual action inconsequential to the condition 
of the system as a whole. Economic behavior depends on how each agent sees the rest of 
the system, and therefore, it differs according to the number of the agents in the system. 
The behavior when there are only two agents in the system would be quite different from 
that when there are 100 agents. Moreover, a market exhibits the property only under 
certain assumptions, and the resultant equilibrium would be Pareto-optimal, which is not • 
necessarily equitable. 43 

Goals of Clients 7 Brokers , and Bidders/Servers 

There were three types of entities in Mariposa: clients, brokers, and bidders/servers [44, 
45], all of which were artificial agents. We assert below that the necessary condition for 
qualifying as an economic application cannot be concluded to have been satisfied and that 
the proposed objective for the broker is unlikely to be practical. A broker sent sub queries 
to bidders and chose the best bid on behalf of the client with a query to be performed. A 
possible scenario was outlined for data query, in which the broker aimed to maximize the 
difference between the budget and the cost. Since the brokers worked for the clients, there 
were two possibilities with respect to their interests: The interests of the brokers and the 
clients were perfectly in line with each other, or they were not. In case the objectives of 
the broker and the client coincided, the broker should have used all the budget available 
to obtain the fastest service possible; minimization of query completion time appears to be 
a more compelling objective for the broker as an agent for a client than the proposed one. 
The objectives of the two would not be the same, if, for example, there are some use for 
unused budget for the brokers, but not for the clients. The brokers would want to maximize 
the unused budget as proposed in the paper, but that would not have any meaning to the 
client. The client would rather have the broker choose the bid that would make the fastest 
query. In this case, the scheme described in the paper would not be supported by the 
clients; there probably would be a great demand for change of the system. 

As for bidders, rough sketches for bidding schemes for data query and storage were 
provided in the papers [44, 45]. However, the utility functions for the bidders/servers are 

43 For detailed discussions on this topic, see, for example, Section 16. C of Microeconomic Theory [29]. 
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unknown, and hence, it cannot be concluded whether the bidding strategies were utility 
maximizing. Each query had its own budget, and no transfer of budget among queries 
seems to have been permissible. No use for unused budget was mentioned. We do not know 
if the necessary condition to be an economic application was met. 

Contribution of Economics 

Experiments regarding the behavior of Mariposa were conducted, with three sites and 
databases of the size 96-128 MB for the wide area network case and those of the size 64-160 
MB for the local area network case [45]. Data movements for the identical query using 
Mariposa and a traditional query optimizer were analyzed, although execution times were 
not compared. The conclusion of the analysis [45] is that Mariposa is superior because it 
gave more choices, in the form of bids, than the traditional optimizer. In order to establish 
that the formulation of a data query problem as an economic one is what makes Mariposa 
desirable, we need to confirm that the best outcome was attained (among the possibilities 
which are more numerous than in other query systems) thanks to the economic behavior 
of the agents involved. We are unable to confirm so, as we do not have enough information 
to affirm the existence of the economic problem in Mariposa. 

3.2.9 Agoric Systems 

An agoric system is an intellectual exploration as to what economics may be able to do 
for distributed computing systems. Without more information than has been provided in 
the paper [33], we cannot draw a conclusion, as to whether the system is an application of 
economics. 

Decentralization: Computing Systems and Markets 

The paper by Miller and Drexler on agoric systems [33] draws our attention to the evolution 
of models in computer science: from centralized to decentralized. They pointed out that 
while economics and any system with goals, resources, etc., have much in common, the 
evolution has made the market mechanism, in particular, relevant to computer science. 
They advanced markets as a mechanism that allows an effective attainment of desirable 
globed goals through locally made decisions, based on some results in the general equilibrium 
theory. 44 In addition, a market, being a decentralized system, was described as potentially 
more rational than a centralized system “since it involves more minds taking into account 
more total information.” The authors’ definition of an agoric system is: a software system 
that is intended to take advantage of such workings. 

Prices as Seen by Hayek 

The paper summarized Hayek’s view on price as follows: “This simple, local decision rule 
gains its power from the ability of market prices to summarize global information about 
relative values.” Although the role of price, as an embodiment of all the relevant information 
in the economy when making economic decisions, has been one of the important components 
in the general equilibrium theory, such prices are available only in an equilibrium [1]. As 
discussed in connection with the model by Kurose and Simha, how such prices could be 
formed has not been part of the theory [1], and there is no auctioneer in markets in reality 

44 For discussions on what properties the equilibria of an abstract economy may have and on under which 
conditions they are brought about, see, for example, Chapters 16 and 17 of Microeconomic Theory [29]. 


30 



who gathers and disseminates information and adjusts prices and/or quantities. In the 
domain of auction theory (one of the few theories that is concerned with the process of price 
determination), McAfee and McMillan [30] asked the following question: “Is it correct, as 
Hayek asserted, that the price summarizes all of the relevant information about supply and 
demand?” They answered in the negative for non-competitive environments. 45 Moreover, 
it has been questioned whether private information, as Hayek saw, is appropriate as that 
incorporated in the price, for the purpose of supporting the general equilibrium theory [51]. 
The powerful role of prices and the possibility of their formation have yet to be shown 
through simulation and implementation of the system. 

3.2.10 Grid Architecture for Computational Economy 

The Grid Architecture for Computational Economy (GRACE) aims at incorporating an 
economic model into a grid system with existing middleware, such as Globus and Legion, 
on the grounds that the economic motivation is better suited than other mechanisms to 
run a distributed computing system [3]. Below we discuss the effect of proposed objectives 
of service providers on pricing as well as simulation results. Although utilities for service 
providers and users were suggested, there was an implication that no alternative uses for 
user budget existed; the scheme does not qualify as an economic application. 

Family of GRACE and Pricing 

Buyya et al. [3] distinguished and named seven possible economic models that may be 
employed by GRACE: commodity market, posted prices, bargaining, tendering, auction, 
proportional resources sharing or shareholder, and community /coalition/bartering. The 
service providers were to share the common objective: “to maximize their resource utiliza- 
tion by offering a competitive service access cost in order to attract consumers.” The paper 
listed important points with respect to price, such as the dependency of pricing policy on 
the objective of the system, 46 the need for careful selection of resources to be charged, and, 
the necessity of accounting and payment procedures, but did not examine how the objective 
may affect pricing. Suppose the users are utility-maximizers with a limited amount of bud- 
get, which has to be carefully dispensed in order to run all the planned jobs. Then, since the 
amount of resources that are available for use is fixed in the short-run, the service providers 
with the above objective would attempt to maximize the utilization rate by altering the 
resource prices, and not the amount of resources. One possible scenario is that, absent 
collusion, which follows from the definition of a competitive environment, underbidding of 
prices by the service providers continues until, at least, one of them provides resources at no 
cost. 47 If some users are rejected by the provider with free resources due to lack of capacity, 
they would turn to other providers, who would engage in a similar price war. As long as 
there are other providers who wish to get as many users as possible and maximize the rate 
of utilization, there will be undercutting of price until one provider sets it equal to zero. 

45 “If the competition is less than perfect it is in the seller’s interest, if possible, to adjust the price after 
the sale in the light of any new information he obtains about the item’s value to the buyer ...” [30]. 

46 The paper appears to differentiate the formation of pricing in each of their models. In fact, price 
formation processes are essentially the same unless prices are imposed. For example, what they call a price 
determined by supply and demand is the same as what they describe as one determined by the objectives of 
service providers and users; supply and demand are shaped by the objectives of service providers and users. 

47 The case is akin to the Bertrand model of price competition, although the suppliers in the model are 
profit-maximizers. For the discussion of the Bertrand model, see, for example, Section 12.C of Microeconomic 
Theory [29]. 
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Another possible scenario is that free resources invite congestion and result in alienation 
of users, who opt for positively priced but not-so-congested resources. In either scenario, 
price fluctuations may be quite large. 

Simulation Results 

As a simulation exercise, CPU time was charged at a flat rate, but differently for peak- and 
off-peak-periods of a day, using a network of four machines and one cluster of computers. 
They were located at three geographically separated institutions, and each of them had the 
capacity of ten nodes. Therefore, although the service providers were supposed to maximize 
the utilization rate of their resources in GRACE, the resource prices were given to them, 
leaving no space for their optimization. This setting precludes the exercise from being a 
simulation of a model with economic application. 

The geographical locations of the computers were Melbourne, Chicago, and Los Angeles, 
and thus, the Australian site and the American sites roughly alternated with respect to 
peak-period. The scheduler, which assigned tasks to various locations, was configured so 
that the cost (the paper appears to imply overall cost) of running jobs was minimized and 
all jobs were completed within an hour after each submission. The paper reported that 
the total cost for the computation of 165 jobs, each of which was “a CPU-intensive task of 
approximately 5 minutes in duration[,]” was smaller than that when the cost minimization 
algorithm was not employed. This result should not be unique to GRACE, but the result 
to be achieved by all properly functioning cost-minimization algorithms. With respect to 
the necessary condition to be an economic application, the users’ utility maximization part 
was met if the utility of each job, which was only implied, was equal to the negative of 
the computation cost. Although not described explicitly, it appears that a budget was 
allocated for each job and no transfer of budget was permitted; the second part of the 
necessary condition was not satisfied. 

The simulation reported in the paper dealt with the problem of matching between 
jobs and computers, which is the main issue in scheduling jobs in a distributed computing 
system. While jobs were differentiated only through submission time, computing resources 
were differentiated through prices, which were fixed for a certain period of time. Hence, 
if the scheduler sought to minimize the total computation costs, as implied in the paper, 
there was effectively no differentiation of jobs, except when they were submitted close to a 
switch between peak- and off-peak-periods. Thus, we are prevented from concluding that 
GRACE tackled the most commonly encountered problem in distributed systems: matching 
of heterogeneous jobs with heterogeneous resources. 

4 Scheduling and Economics in Practice 

4.1 Have We Applied Economics? 

We have examined above the representative scheduling mechanisms for non-distributed 
and distributed computing systems, which aimed at incorporating economics. Our crite- 
rion for judging that a scheduling mechanism was based on economics was confirmation 
that the outcome was achieved through utility-maximizing behavior of the participants, 
given scarcity of resources and the existence of alternative uses of resources which lead to 
different utility levels. The participants included computing-service providers* in addition 
to service users, if they interacted in the process of resource-allocation determination. If 
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the desirable outcomes were achievable only with economically motivated behavior, that 
fact was sufficient to conclude that the scheme was based on economics. Further, we may 
say that a scheduling which utilizes an economic model is superior to other scheduling 
mechanisms, if the mechanisms are applied to the same situations and the performance of 
the one with an economic model is better in view of the scheduling goal. We could not 
conclude that the criterion for an economic application was satisfied by any of the models 
examined. Moreover, there was no comparison of their performances with those using other 
scheduling mechanisms. Hence, no support was provided for establishing that economics is 
a necessary component for superior performance of distributed computing systems. 

4*2 Bidding and Auction 

Most of the mechanisms examined employed an economic procedure called bidding (Suther- 
land’s, the Contract Net Protocol, the Enterprise, Spawn, WALRAS, Mariposa, and GRACE) 
Bidding is useful when bidders do not have clear descriptions of their own utilities or do 
not wish to communicate them in order to obtain the best deal. Compared to negotiation, 
bidding is more suited for multiple sellers and buyers, more open, and probably, less time 
consuming. An auction, which consists of biddings, is a forum for competing traders to ex- 
press their desire to trade (i.e., to reveal preferences) so that the trade takes place in terms 
that are most favorable to them (i.e., to maximize utility from the auction). The expression 
of their desire is affected by the presence of competing traders or bidders. This is because 
the expression of weak willingness to trade works in favor of the buyer with respect to the 
final price, but it works against their establishing a trade due to other traders who are 
competing for the same trade. In other words, auctions reveal traders’ preferences that are 
influenced by their perception of other bidders’ preferences. Since we cannot say that any 
of the Contract Net Protocol, the Enterprise, Spawn, Mariposa, and WALRAS employed 
utility maximizing agents, we cannot conclude what they called biddings were those with 
basis in economics. Strictly speaking, the reporting by the local agents in tatonnement pro- 
cesses in the general equilibrium theory are not bidding, unless there are infinite number 
of traders. 

Bidding assumes heterogeneity of bidders. There would be redundancy in collecting 
bids from all agents in the system if they are homogeneous. In addition, if there are no 
other uses for what is to be given up in order to obtain the item, the best strategy is to bid 
the entire resources that are at one’s disposal. That was the case in Sutherland’s scheme 
and Spawn. Subsequently, the willingness to pay, or the preference for the item in question, 
becomes indistinguishable from the budget size, ridding an auction of its main function of 
preference revelation. 

Differentiation of a resource through pricing, which is dependent on the time of the day, 
expresses the preferences of the price-setter, but does not fall into the category of auctions, 
if there is only one price in the presence of heterogeneous sellers, or if there are multiple 
prices, each of which is for a mutually unsubstitutable item. The prices were set uniformly 
across sites on the same continent by the administrative authority in the simulation example 
of GRACE, and therefore, we conclude that it was an auction, only under the assumption 
that the sites on a continent are identical. 
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4.3 Future Direction 

Before we attempt to construct a scheduling mechanism which genuinely applies economics, 
we should ask the following questions: All the proposals for distributed systems that were 
examined used, or implied the use of, artificial agents — are they necessary and do they 
have the potential to provide better scheduling than without? Would the use of artificial 
agents in place of human users alter the workings of computing resource markets? We have 
established that the problem in scheduling can be seen as that in economics under certain 
conditions, but how relevant is the general equilibrium theory, which is more narrowly 
focused than the whole discipline of economics, to scheduling? More generally, we should 
question the general equilibrium theory and markets themselves. The actual economy 
appears to work well on its own, and the general equilibrium theory is often taken as 
a good abstraction of that seamless working. Does the theory capture what drives the 
economy to behave well as a system? If not, applying the general equilibrium theory 
to scheduling would not provide a “mechanism that somehow works successfully without 
intervention.” Are markets capable of producing the favorable outcomes as the general 
equilibrium theory implies, and subsequently, asserted by the architects of market-based 
scheduling? What exactly are the intricacies posed by the issue of global scheduling, and 
is economics equipped to handle them? We believe that many of these questions can be 
answered, at least partially, through a careful reading of the general equilibrium theory and 
its related fields. 
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